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What is claimed is 

1 . A face detection and tracking system for detecting and tracking 
a plurality of faces in real time from an input image, the system comprising: 

a background removing unit which extracts an area having a motion by 
5 removing the background image from the input image; 

a candidate area extracting unit which extracts a candidate area in 
which a face is possibly located in the area having a motion, by using a skin 
color probability map (P S kin) generated from a face skin color model and the 
global probability map (Pgiobai); 
10 a face area determination unit which extracts independent component 

analysis (ICA) features from a candidate area and determines whether or not 
the candidate area is a face area; and 

a face area tracking unit which tracks a face area according to a 
directional kernel indicating a probability that a face is located in a next frame, 
15 based on the skin color probability map. 

2. The system of claim 1, wherein the candidate area extracting 
unit comprises: 

a skin color probability map generation unit which generates a skin 
20 color probability map (P S kin) of the area having a motion, by using a face skin 
color model; 

a global probability map generation unit which extracts a plurality of 
highest points of the area having a motion, sets central coordinates at a 
predetermined distance from the plurality of highest points, and calculates a 

25 probability that a face is located within a distance from the central coordinates, 
to generate a global probability map (Pgiobai); and 

a multiple scale probability map generation unit which generates a 
multiple scale probability map about the probability that a face is located, by 
multiplying the skin color probability map and the global probability map (Pgiobai), 

30 and extracts an area, in which the probability value of the generated multiple 
scale probability map is equal to or greater than a predetermined threshold 
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value, as a candidate area where a face is possibly located 



3. The system of claim 2, wherein the skin color probability map 
generation unit converts the color of each pixel in the area having a motion into 
5 hue and saturation values, and applies the values to a face skin color model 
which is a 2-dimensional Gaussian model that is trained in advance with a 
variety of skin colors, to generate a skin color probability map indicating a 
probability that the color of an area having a motion is a skin color. 

10 4. The system of claim 3, wherein when Hue(ij) and Sat(ij) 

denote the hue and saturation at coordinates (ij) of the area having a motion, 
respectively, wand denote the average and distribution of Gaussian 
dispersion, respectively, and the size of a face desired to be searched for is n, 
the skin color probability map P S kin(x,y,n) is generated according to the following 

is equation: 



i=x+n/2 j=y+n/2 

X ^g(Hue{i,j),Sat(i,j);u,?:) 



r> / \ i=x~n/2 j-y-n/2 
P S kin (*>y> n) = 1 2 

n 



5. The system of claim 2, wherein when $. denotes the central 

20 coordinates of the candidate area, denotes a dispersion matrix, n denotes the 
size of a face area, and (x,,y,) denotes the coordinates of each local area (i), the 
global probability map generation unit generates global probability map Pgiobai 
(x,y,n) according to the following equation: 



N 



25 P global (x, y 9 n) = ^] g(x. , y i ; ff. , S) 



where fi. , , x,, and y, satisfies the following equations, respectively: 

18 
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^ uj\ (m^ + «cos(Z(-«(m J )))^ 
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m iy + ^sin(Z(-w(m / ))) 



, 2 = 



^2 

n 



J 
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2 \ 



1^1. 5n 2 (1.5rc) 2 .J 



^ ^cos(Z(n(^.)) -sin(Z(H(™,)) ^ f*~0 



sin(Z(«(m / )) cos(Z(« ^ 



5 6. The system of claim 1 , wherein the face area determination unit 

comprises: 

an ICA feature extracting unit which extracts features by performing ICA 
on the extracted face candidate area; and 

a face determination unit which determines whether or not the 
10 candidate area is a face, by providing the ICA features of the candidate area to 
a support vector machine (SVM) which has learned features obtained by 
performing ICA on learning face images and features obtained by performing 
ICA on images that are not a face. 



15 7. The system of claim 1, wherein when it is assumed that the 

coordinates at which the center of a face is to be located, and the dispersion are 

(p x , |j y ) and (o x ,o y ), respectively, and a\ = 2(a 2 x + A/; 2 ), ^ 2 =2(cr 2 + A// 2 ), 
x — u x — u 

Z = — £^7 — ^, if the probability that a face is located is 



a o 

x ~ y 



f(x,y,a x ,cr y ) = ~exp\ 



2(1 -<) 



the direction kernel is 



20 expressed as f(x 9 y, <y x ,cr y ) in the direction in which the face area moves, and 
expressed as f(x 9 y, a x , a ) in the opposite direction. 



8. The system of claim 1, wherein the background removing unit 
obtains a first area which is not a background, by using the brightness 
25 difference of the input image and a background image stored in advance, and 
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obtains a second area which is not the background, by using the color 
difference of the two images, and among a plurality of sub-areas included in the 
second area that is not the background, and extracts each sub-area which 
includes the center of a sub-area included in the first area that is not the 
5 background, as areas that are not background, to remove the background 
image from the input image and extract an area having a motion. 



10 



9. The system of claim 8, wherein the background removing unit 
updates a new background image R'(x,y) according to the following equation: 

%)=j«( V )+(i-^y 



where R(x,y) denotes an existing background image, B(x,y) denotes a binary 
image in which an area having a motion is removed form the input image, and 
15 p denotes an update constant. 



10. A face detection and tracking system for detecting and tracking 
a plurality of faces in real time from an input image, the system comprising: 

a background removing unit which obtains a first area which is not a 

20 background, by using the brightness difference of an input image and a 
background image stored in advance, and obtains a second area which is not 
the background, by using the color difference of the two images, and among a 
plurality of sub-areas included in the second area that is not the background, 
and extracts each sub-area which includes the center of a sub-area included in 

25 the first area that is not the background, as areas that are not background, to 
remove the background image from the input image and extract an area having 
a motion; 

a skin color probability map generation unit which generates a skin 
color probability map (P S kin) of the area having a motion, by using a face skin 
30 color model; 
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a global probability map generation unit which extracts a plurality of 
highest points of the area having a motion, sets central coordinates at a 
predetermined distance from the plurality of highest points, calculates a 
probability that a face is located within a predetermined distance from the 

5 central coordinates, to generate global probability map (Pgiobai) 

a multiple scale probability map generation unit which generates a 
multiple scale probability map about the probability that a face is located, by 
multiplying the skin color probability map and the global probability map (Pgiobai), 
and extracts an area, in which the probability value of the generated multiple 

10 scale probability map is equal to or greater than a predetermined threshold 
value, as a candidate area where a face is possibly located; 

a face area determination unit which extracts independent component 
analysis (ICA) features from a candidate area and determines whether or not 
the candidate area is a face area, by providing the ICA features of the candidate 

is area to a support vector machine (SVM) which has learned features obtained by 
performing ICA on learning face images and features obtained by performing 
ICA on images that are not a face; and 

a face area tracking unit which tracks a face area according to a 
directional kernel indicating a probability that a face is located in a next frame, 

20 based on the skin color probability map. 

11 . A face detection and tracking method for detecting and tracking 
a plurality of faces in real time from an input image, the method comprising: 

(a) extracting an area having a motion by removing the background 
25 image from the input image; 

(b) extracting a candidate area in which a face is possibly located in the 
area having a motion, by using a skin color probability map (P S kin) generated 
from a face skin color model and the global probability map (Pgiobai); 

(c) extracting independent component analysis (ICA) features from a 
30 candidate area and determining whether or not the candidate area is a face 

area; and 
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(d) tracking a face area according to a directional kernel indicating a 
probability that a face is located in a next frame, based on the skin color 
probability map. 

5 1 2. The method of claim 1 1 , wherein step (b) comprises: 

=) 

(b1) generating a skin color probability map (P S kin) of the area having a 
motion, by using a face skin color model; 

(b2) extracting a plurality of highest points of the area having a motion, 
setting central coordinates at a predetermined distance from the plurality of 
10 highest points, and calculating a probability that a face is located within a 
predetermined distance from the central coordinates, to generate a global 
probability map (Pgiobai); and 

(b3) generating a multiple scale probability map about the probability 
that a face is located, by multiplying the skin color probability map and the 
15 global probability map (Pgjobai), and extracting an area, in which the probability 
value of the generated multiple scale probability map is equal to or greater than 
a predetermined threshold value, as a candidate area where a face is possibly 
located. 

20 13. The method of claim 12, wherein in step (b1) the color of each 

pixel in the area having a motion is converted into hue and saturation values 
and the values is applied to a face skin color model which is a 2-dimensional 
Gaussian model that is trained in advance with a variety of skin colors, to 
generate a skin color probability map indicating a probability that the color of an 

25 area having a motion is a skin color. 

14. The method of claim 13, wherein when Hue(ij) and Sat(iJ) 
denote the hue and saturation at coordinates (ij) of the area having a motion, 
respectively, wand denote the average and distribution of Gaussian 
30 dispersion, respectively, and the size of a face desired to be searched for is n, 
the skin color probability map P S kin(x,y,n) is generated according to the following 

22 
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equation: 



Yj Y^siHue{i,j),Sat{i,j);u,Y) 

i=x~n/2 j-y-n(2 



n 



10 



15. The method of claim 12, wherein in step (b2), 
when u i denotes the central coordinates of the candidate area, denotes a 

dispersion matrix, n denotes the size of a face area, and (Xi,yi) denotes the 
coordinates of each local area (i), global probability map Pgiobai (x,y,n) is 
generated according to the following equation: 



where £. , , Xj, and y\ satisfies the following equations, respectively: 



15 
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16. The method of claim 11, wherein step (c) comprises: 
20 extracting features by performing ICA on the extracted face candidate 

area; and 

determining whether or not the candidate area is a face, by providing 
the ICA features of the candidate area to a support vector machine (SVM) which 
has learned features obtained by performing ICA on learning face images and 
25 features obtained by performing ICA on images that are not a face. 
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17. The method of claim 11, wherein when it is assumed that the 
coordinates at which the center of a face is to be located, and the dispersion are 



(Mx, My) and (o x ,a y ), respectively, and a] = 2{a x + Atf), a y = 2(cr y + Aju'), 



.2\ —2 /->/-_2 . A ..2 



z x = 



, if the probability that a face is located is 



f(x,y,a x ,a v ) = ^--exp 



-(Z 2 x -2cv xy Z x Z y + Z 2 y ) 



20 -<) 



the direction kernel is 



expressed as f(x,y, a x ,a y ) in the direction in which the face area moves, and 
expressed as f(x,y, a x ,a ) in the opposite direction. 



18. The method of claim 11 , wherein in step (a), a first area which is 
not a background is obtained by using the brightness difference of the input 
image and a background image stored in advance, and a second area which is 
not the background is obtained by using the color difference of the two images, 
and among a plurality of sub-areas included in the second area that is not the 
background, each sub-area, which includes the center of a sub-area included in 
the first area that is not the background, is extracted as an area that is not the 
background, so that the background image is removed from the input image 
and an area having a motion is extracted. 



19. The method of claim 18, wherein in step (a), a new background 
image R'(x,y) is updated according to the following equation: 



R'(x,y) = PR(x,y)Hl-P)B(x 9 y) 



where R(x,y) denotes an existing background image, B(x,y) denotes a binary 
image in which an area having a motion is removed form the input image, and 
p denotes an update constant. 
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20. A face detection and tracking method for detecting and tracking 
a plurality of faces in real time by combining visual information of an input 
image, 

the method comprising: 

5 obtaining a first area which is not a background by using the brightness 

difference of an input image and a background image stored in advance, and 
obtaining a second area which is not the background, by using the color 
difference of the two Images, and among a plurality of sub-areas included in the 
second area that is not the background, and extracting each sub-area which 

10 includes the center of a sub-area included in the first area that is not the 
background, as areas that are not background, to remove the background 
image from the input image and extract an area having a motion; 

generating a skin color probability map (P S kin) of the area having a 
motion, by using a face skin color model; 

15 extracting a plurality of highest points of the area having a motion, 

setting central coordinates at a predetermined distance from the plurality of 
highest points, and calculating a probability that a face is located within a 
predetermined distance from the central coordinates, to generate global 

probability map (P g i 0 bai); 

20 generating a multiple scale probability map about the probability that a 

face is located, by multiplying the skin color probability map and the global 
probability map (Pgiobai), and extracting an area, in which the probability value of 
the generated multiple scale probability map is equal to or greater than a 
predetermined threshold value, as a candidate area where a face is possibly 

25 located, to generate a multiple scale probability map; 

extracting independent component analysis (ICA) features from a 
candidate area and determining whether or not the candidate area is a face 
area, by providing the ICA features of the candidate area to a support vector 
machine (SVM) which has learned features obtained by performing ICA on 

30 learning face images and features obtained by performing ICA on images that 
are not a face; and 
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tracking a face area according to a directional kernel indicating a 
probability that a face is located in a next frame, based on the skin color 
probability map, 

21. A computer readable medium having embodied thereon a 
computer program for the method of claim 1 1 . 
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